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ABSTRACT 



This sampler lists resources concerning evaluation and 
accountability related to mental health in schools that are relatively easy 
to access through libraries, by phone, or over the Internet. Part 1 includes 
references to books, book chapters, articles, briefs, reports, fact sheets, 
and other printed resources; guidebooks and models; agencies; web sites; and 
other related resources from the University of California Los Angeles (UCLA) 
Center for Mental Health in Schools Training and Technical Assistance Center 
Part 2 contains an annotated bibliography of documents concerning quality 
assurance from the UCLA Center for Mental Health in Schools Training and 
Technical Assistance Center *s clearinghouse. Part 3 is a regional list of 
consultants . (MKA) 
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TECHMICAL A\SSISTA\MCE 




We realize that each individual and organization requesting technical 
assistance has unique and special information needs. To accommodate 
this diversity, we are developing samplers to provide immediate 
information on a variety of resources and how to access them. 



In compiling samplers, we conduct a search of agencies, organizations, 
the Internet, relevant programs, and library resources. Then, we select a 
sample of diverse resources — including resources that are themselves 
links to other resources and information. We also provide information on 
how to access other knowledgeable individuals who are ready to offer 
assistance. All resources listed are relatively easy to access through 
libraries, by phone, or over the Internet. If you are not yet connected to 
the Internet, hopefully you have access through work, a local library, or 
a friend. 



We hope the attached sampler is sufficient to meet your needs. However, 
should you require further help, please let us know. And should you 
know of something you think we should add, let us know this as well. 




The center is co-directed by Howard Adelman and Linda Taylor and operates 

under the auspices of the School Mental Health Project, Dept of Psychology, UCLA. 

Address: Center for Mental Health in Schools, Box 951563, Los Angeles, CA 90095-1563 
Phone: (3 1 0) 825-3634 ■ Fax: (3 1 0) 206-87 1 6 ■ Email: smhp@ucla.edu 
Website: http://smhp.psych.ucla.edu 

Support comes in part from the U.S. Department of Health and Human Services, 

Public Health Service Health Resources and Services Administration, 

Maternal and Child Health Bureau, Office of Adolescent Health. PubbcHcoiihScrvifs 




Center for Mental Health in Schools 

1 / 5 / 9 ^ 




Clearinghouse Sampler on: 



Evaluation and Accountability 
Related to Mental Health in Schools 



As an early step in accessing information and assistance on the above topic, the resources listed here 
are relatively basic and easy to access through libraries, by phone, or over the Internet. (If you're not 
yet connected to the Internet, hopefully you have access through work, a local library, or a friend.) 
Many local college or university libraries allow noncampus members to use their services 
(sometimes for a small fee). Also, many libraries have interlibrary loan programs. 



I. Books, book chapters, articles, briefs, reports, fact sheets 

and other printed resources 

In this section are a few publications offering a general perspective on the topic. 

Books and Book Chapters 

Herman, J.L., Morris, L.L., & Fitz-Gibbon, C.T. (1987). Evaluator’s Handbook: Vol. 1 

(160 pgs.). In Program Evaluation Kit. Thousand Oaks, CA: Sage, (phone: 805/499-9774) 

This volume provides a broad overview of evaluation planning and a practical guide to designing and 
managing programs. Attention is given to establishing an evaluation's parameters, the how-to's of 
formative and summative evaluation, and combining quantitative and qualitative approaches. Also 
covered are user needs and socio-political factors influencing an evaluation. 



Adelman, H.S. & Taylor, L. (1993). Learning Problems and Learning Disabilities: Moving 
Forward. Pacific Groves, CA: Brooks/Cole. 

The chapter entitled “Evaluating Effectiveness” (pp. 253-267) provides a general introduction covering 
the importance of focusing on specific results and choosing appropriate measures. Also included is an 
overview of Robert Stake’s evaluation framework. 



Essock, S. & Goldman, H. (1997). Outcomes and evaluation: System, program and clinician 
level measures In K. Minkoff & D. Pollack (Eds.) Managed Mental Health Care in the 
Public Sector: A Survival Manual. Singapore: Harwood Academic Publishers, (pp. 295-307). 

Focuses on measurement of outcomes relevant to managed care mental health service systems. Topics 
include a framework for evaluating mental health services, what should be measured, and how outcome 
data are collected. 



Hargreaves, W., Shumway, M., Hu, T., & Cuffel, B. (1998). Cost-Outcome Methods for Mental 
Health. (242 pp.) San Diego CA: Academic Press. 




Discusses various approaches to cost-outcome studies, especially cost-effectiveness and cost-utility 
analysis as they apply to mental health services; designing cost-outcome studies; measuring costs 
interventions, and outcomes; analyzing study results; and using findings to guide policy and practice. 
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Weiss, H.B. & Jacobs, F.H. (1988). Evaluating family programs. (556 pp.) Hawthorne, NY; 
Aldine de Gruyter. 

Presents a broad developmental framework for evaluation applicable to both small community programs 
and large research and demonstration programs. Reviews and recommends measures for assessing 
effectiveness at multiple levels, including child, parent-child interaction, parent, family system, family 
stress and coping, and intra- and extrafamilial social support. 



Yates, B.T. (1996). Analyzing Costs, Procedures, Processes, and Outcomes in Human Services. 
Thousand Oaks, CA: Sage. (161 pp.) 

Introduces techniques for performing cost-effectiveness analysis and cost-benefits analysis in mental 
health and other human services. 



Journal Articles, Briefs, and Reports 

Burchard, J.D. & Schaefer, M. (1992). Improving accountability in a service delivery system in 
children’s mental health. Clinical Psychology Review, 12, 867-882. 

Discusses increasing concern for public agency accountability and limitations of traditional evaluation 
methods for meeting this need. Three methods are described to monitor the progress of children 
receiving services within a public service delivery system ... measurement of daily adjustment, 
residential and educational service tracking, and an approach for integrating and displaying individual 
case information related to child behavior, life and family events, services received, and service costs. 
Also discussed are methods to track units of service and youth and parent satisfaction. 



Morrissey, J.P. (1992). An interorganizational network approach to evaluating children’s mental 
health service systems. New Directions for Program Evaluation, 54, 85-99. 

Assesses systems of services at the community level for children and youth with severe emotional 
disturbances. 



Plante, T.G., Couchman, C.E., & Diaz, A.R. (1995). Measuring treatment outcome and client 
satisfaction among children and families. Special Section; Outcomes research. Journal of 
Mental Health Administration, 22, 261-269. 

Describes a treatment outcome and client satisfaction assessment program that provides comprehensive 
mental health services to children and families. The program uses the Child and Adolescent Adjustment 
Profile, the Brief Psychiatric Rating Scale for Children, the Client Satisfaction Questionnaire, and the 
Demographic Questionnaire (DQ) for assessment. The DQ is appended. 



Rugs, D. & Kutash, K. (1994). Evaluating children's mental health service systems; An analysis 
of critical behaviors and events. Journal of Child & Family Studies, 3, 249-262. 

Reviews 5 social validation surveys, carried out in 5 states, which examined children's mental health 
outcome measures. Respondents consider behavior of all children in the community, not just 
handicapped youth. A model of critical behaviors and events is presented that includes critical incident 
indicators, role performance indicators, and moderating factors. 
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Grason, H. & Guyer, B. (1995). Quality, Quality Assessment, and Quality Assurance 

Considerations for Maternal and Child Health Populations and Practitioners. Baltimore: 
The Child and Adolescent health Policy Center, The Johns Hopkins University. 

Discusses concepts and practices related to quality assurance and health care. 



n. Guidebooks and models 

Evaluating the Outcome of Children’s Mental Health Services: A Guide for the Use of 
Available Child and Family Outcome Measures (1995) — by T.P. Cross & E. McDonald 

Discusses ways to use available standardized child and family outcome measures in the development 
of an outcome measurement plan. Describes the process used to select a standard instrument; discusses 
criteria used as the basis for instrument selection; presents basic information on a selected set of 
instruments suitable for use in measuring child and family outcomes. 

Contact; The Technical Assistance Center for the Evaluation of Children’s Mental Health 
Systems Judge Baker Children’s Center, 295 Longwood Ave., Boston, MA 02115 
Phone: (617) 232-8390/ Fax: (617) 232-4125 



Center for the Study of Evaluation: Program Evaluation Kit (1987) 

This nine volume kit offers a step-by-step guide to planning and conducting program evaluations. Titles 
include: Evaluator 's handbook, How to focus on evaluation, How to design a program evaluation. How 
to use qualitative methods in evaluation. How to assess program implementation. How to measure 
attitudes. How to measure performance and use tests. How to analyze data, and How to communicate 
evaluation findings. 

Contact: Sage Publications, Inc., P.O. Box 5084, Thousand Oaks CA 91359-9924 

Telephone: (805) 499-9774 Fax: (805) 499-0871 Internet: order@sagepub.com 



How Good is Your Drug Abuse Treatment Program? A Guide to Evaluation (1993) — by 
the National Institute on Drug Abuse (NCADI #BKD104) 

Outlines a 52 week evaluation plan and steps necessary to meet each week’s goals. The model 
encompasses developing a program plan, with concrete objectives and goals; organizing resources; 
operationalizing measures; developing a research design; collecting and analyzing data; and reporting 
and using findings. Also outlined is how to use the developments from earlier steps as stepping stones 
to later ones. Although the model pertains to drug treatment programs, the basic strategies can be 
applied to various intervention programs. 

Contact: The National Technical Information Service order desk, 5285 Port Royal Road 
Springfield, VA 22161 Phone: 703-487-4650 FAX: 703-321-8547 
(To verify receipt of fax, call 703-487-4679) For RUSH service: 1-800-553-NTlS 



A. Rosenblatt & C. Attkinsson (1993). Assessing outcomes for sufferers of severe mental 
disorder: a conceptual framework and review. Evaluation and Prof^ram Planning, 16, 
347-363. 

Presents a conceptual framework to classify the outcomes of services (and thus outcome measures). The 
classification framework integrates three dimensions: (I) respondent type, which reflects a range of 
social perspectives: client, family, social, clinician, and scientist; (2) social context of measurement, 
which states that measures must be taken in the context of all areas of functioning: individual/self, 
family, work/school, community; (3) treatment outcomes, is based on the need for multiple measures 
and approaches to measuring outcomes for persons suffering from severe mental disorders. 



Two Clearinghouse Briefs 



Mental Health in Schools: Quality Control, Evaluating Outcomes, and Getting Credit 
for All You Do 

A brief discussion emphasizes viewing children and children’s services from a holistic perspective 
(e.g., viewing children in the context of families and communities). States that in order to provide 
services that enhance outcomes for many clients, it often is necessary also to evaluate the systems 
that determine such outcomes (e.g., family education support programs, school-based health centers, 
off-site services, the community at large). Reviews issues and possible solutions concerning 
evaluation for improving systems and processes, evaluation of outcomes (e.g., student outcomes), 
and evaluating the impact on families and the community. 

Evaluation, Accountability, and Mental Health in Schools 

A brief discussion reviewing the different interested parties that have a stake in accountability (e.g., 
society, the institution of schooling, and youngsters and their families) and the different indicators 
and measures that each party requires. Also explores the need for sampling and appropriate 
standards for comparison. 

Both brief papers are included in our Center’s introductory packet on Evaluation and 
Accountability: Getting Credit for All You Do. Available at cost ($3.50). See 
information at the end of this sampler. 



K. Hoagwood, P. S. Jensen, T. Petti, & B. J. Bums (1996). Outcomes of Mental Health Care 
for Children and Adolescents: I. A Comprehensive Conceptual Model. Journal of the 
American Academy of Child and Adolescent Psychiatry, 35. 

Outlines a dynamic and interactional model of outcomes that broadens the range of intended 
consequences of care. It comprises five domains: Symptoms, functioning, consumer perspectives, 
environmental contexts and systems. Tlie model reflects the changeable interaction between children’s 
evolving capacities and their primary environments (home, school, and community). 



in. Agencies 

In addition to our Center and the Center for School Mental Health Assistance (University of 
Maryland at Baltimore)— which provide technical assistance support and put out a variety of 
publications— the following agencies can also be of assistance. 

ERIC— Clearinghouse on Assessment and Evaluation 

The Educational Resources Information Center (ERIC) is a national information system. One of its 
divisions focuses on assessment and evaluation, providing access to technical assistance services as well 
as documents and reports, test banks, and more. Their web site provides links to relevant sites and 
information on many other ERIC programs and services. 

Contact; O’Boyle Hall, Department of Education, The Catholic University of America 
Washington, DC 20064 Website: http://www.cua.edu/www/eric_ae/MAlN.HTM 



Harvard Family Research Project 




Focuses on family support programs and policies; provides technical assistance to a nationwide network 
of practitioners, policy makers, and educators. Publishes "The Evaluation Exchange," a quarterly 
newsletter; their website links to agencies, foundations and think tanks involved in child and family 
issues and research. 

Contact: Harvard Family Research Project, 38 Concord Avenue, Cambridge, MA 02138 
Phone: (6 1 7) 495-9 1 08 Email: hfrp(^hugse 1 .harvard.edu 

Website: http://hugse 1 .harvard.edu/~hfrp/ 
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National Center for Educational Outcomes (NCEO) 

Specializes in the identification of outcomes, indicators, and assessments to monitor educational results 
for all students including students with disabilities. Has an extensive publication list, a directory of 
assessment projects, a national network of technical assistance providers. 

Contact: University of Minnesota, 350 Elliott Hall, 75 East River Road 

Minneapolis, MN 55455 Phone: (612) 626-1530 Fax: (612) 624-0879 

Website: http://www.coled.umn.edu/nceo/ 

Technical Assistance Center for the Evaluation of Children’s Mental Health Systems 

Located at Judge Baker Children’s Center, this agency provides consultation and has a library of 
measures, manuals, and articles, including Evaluating the Outcome of Children ’s Mental Health 
Services: A Guide for the Use of Available Child and Family Outcome Measures (1995) cited above. 
Contact: Christina Crowe, Director, 295 Longwood Ave., Boston, MA 02115 
Phone: (617) 232-4125 or (800) 779-8390 Fax: (617) 232-4125 
Website: http://tac.pie.org/T3632 



IV. Web sites 

Internet websites can be goldniines of information. They have reports, publications, online 
resources (e.g., catalogs, technical assistance), model programs, and links to other resources. 

Assessment and Evaluation on the Internet 
Website: http://ericae2.educ.cua.edU/intbod.stm#AA 

Developed by The Educational Resources Information Center (ERIC) to provide online services and 
documents pertaining to assessment and evaluation; contains information on special issues in 
evaluation, test descriptions, lists of online test publishers, and much more. 

The Evaluation Clearinghouse 

Website: http://www3.sympatico.ca/gpic/evalweb.htm 

Specializes in linking to useful information and organizations related to evaluation and assessment; has 
online documents, information discussion groups, links to relevant evaluation organizations and think 
tanks, and more. 



V. Other related resources irom our Center 

If you need additional assistance, we have the following resources: 

A. Documents from our Clearinghouse 

Our Center has compiled an extensive clearinghouse on a variety of topics relevant to addressing 
barriers to learning.The attached list summarizes our current holdings related to evaluation. 

B. Consultation Cadre 



Sometimes the best way to get information is to talk with someone who has successfully done what you 
want to do. Our center has compiled a list of professionals from all parts of the country who are willing 
to provide free informal consultation. See the attached list of cadre members who have identified 
themselves as having evaluation expertise. 

C. Center staff who can provide additional technical assistance 




Our center is continually updating and expanding resources. If you need additional 
information regarding this or any other issue that pertains to mental health in 
schools, please feel free to contact us. 
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Documents in Our Clearinghouse 




Our Clearinghouse has information on a variety of topics relevant to 
mental health in schools specifically and addressing barriers to learning 
in general. We have collected resources from across the country. Most of 
what we have gathered is still in its original form (e.g., guides, resource 
aids, instruments, articles, fact sheets, reports, etc.). Over time, we are 
integrating some of the material into specially developed Introductory, 
Resource Aid, and Technical Aid Packets. The attached list highlights 
additional items from our current holdings. For material that is still in its 
original form, you probably will want to directly contact the source. 
However, if this is not feasible, feel free to contact us. 



The center is co-directed by Howard Adelman and Linda Taylor and operates 

under the auspices of the School Mental Health Project, Dept, of Psychology, UCLA. 



Address: Center for Mental Health in Schools, Box 95 1563, Los Angeles, CA 90095-1563 
Phone:(310) 825-3634 ■ Fax:(310) 206-8716 ■ Email: smhp@ucla.edu 

Website: http://smhp.psych.ucla.edu 

Support comes in part from the U.S. Department of Health and Human Services, 

Public Health Service, Health Resources and Services Administration, 

Maternal and Child Health Bureau, Office of Adolescent Health. 
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Center for Mental Health in Schools 

1/5/98 

From the Clearinghouse Catalogue 

Evaluation and Quality Assurance 



Title: How to Use Site-Monitoring Teams to Evaluate School-Based/Linked Health Centers 

(1993) Center for Population Options, Washington, D.C. 

A pamphlet containing a step-by-step guide to conducting service delivery in the early stages of a program. 

Source: The Center for Population Options; 1 025 Vermont Ave., N W, Suite 2 1 0; 

Washington, D.C., 20005; Phone: (202) 347-5700; FAX: (202) 347-2263 

Center’s Clearinghouse Number: 1405-7 



Title: A Start-Up List of Outcome Measures With Annotations (1994) Improved Outcomes for 

Children Project 

A report outlining different concerns related to childhood and adolescence, such as low birthweight, violent 
youth crime, child poverty. Presents each area in terms of indicator, definition, significance, facts, data sources 
and related measures. 

Source: Improved Outcomes for Children Project (ICOP); 1250 Eye St., NW, 

Suite 503; Washington, D.C., 20005; Phone: (202) 371-1565 

Center’s Clearinghouse Number: 1405-24 



Title: Program Description and Evaluation of The Special Populations Task Force (1995) 

L. Gordon, D. Smith, B. McNulty, & W.T. Randall 

A report from a Colorado group advocating for students with special needs; outlines school practices that aid 
students with special needs to reach higher expectations. 

Source: Colorado Department of Education; State Office Building, 201 E. Colfax; Denver, Colorado, 80203 

Center’s Clearinghouse Number: 1405-23 



Title: A Framework for Improving Outcomes for Children and Families (1994) 

Improved Outcomes for Children Project 

Report created to assist communities in the National Alliance for Restructuring Education in pursuing a reform 
agenda. Describes key ingredients of a system of community supports to help prepare all children to participate 
successfully in school, help strengthen family capacities to contribute to and support children's educational 
progress, and ensure effective functioning and continued evolution of the services and supports needed to 
improve children's educational outcomes. 

Source: Center for the Study of Social Policy, 1250 Eye Street, NW, Suite 503 

Washington, DC 20008, Phone: (202) 371-1565; Fax: (202) 371-1472. 

Center’s Clearinghouse Number: 1405-22 



Title: Community Report Cards: Making Kids Count (1996) S.L. Gardner 

A guide on how communities can use report cards to measure what is now happening to their children, and then 
to monitor progress every year against those benchmarks. Sets out the values of a report card approach, 
describes different methods to assemble both the data and a coalition to work on the data, raises issues of 
interpretation of data, and summarizes important political and policy issues that arise in publicizing the data. 

Source: Center for the Collaboration for Children, California State University, Fullerton 

800 North State College Blvd., Fullerton, CA 92634; Phone: (714) 773-3313; Fax: (714) 449-4584. 

Center’s Clearinghouse Number: 1 405-2 1 



Title: 



Holistic Quality: Managing, Restructuring, and Empowering Schools (1993) JJ. Herman 

Handbook addressing how to manage, restructure, and empower schools via holistic methods. Discusses quality 
management, effective schools research, school-based management, and strategic and tactical planning 

Source: The Practicing Administrator's Leadership Series, Corwin Press, Inc.; 2455 Teller Road; 

Newbury Park, CA, 91320 

Center’s Clearinghouse Number: 1405-20 



Title: Measuring the Health Behavior of Adolescents: The Youth Risk Behavior Surveillance 

System and Recent Reports on High-Risk Adolescents (1993) Public Health Reports 

Report documenting the health behavior of adolescents; includes data on high-risk adolescents. 

Source: Public Health Reports, 108 (suppl. I) Inquiries about subscriptions or orders may be 

directed to Superintendent of Documents, Order Desk; U.S. Government Printing Office; 
Washington, D.C., 20402-9371; Phone: (202) 783-3238 

Center’s Clearinghouse Number: 1405-18 



Title: Youth Risk Behavior Surveillance Report ( 1 995). Morbidity and Mortality Weekly 

Discusses the results of youth risk behavior surveillance in the U.S. in 1993. 

Source: Single copies of this document are available from CDCs Division of Adolescent and 

School Health; National Center for Chronic Disease Prevention and Health Promotion; 

Mailstop K-33, 4770 Buford Highway, NE; Atlanta, GA, 30341-3724; Phone: (404) 488-5330 

Center’s Clearinghouse Number: 1 405- 1 7 



Title: Maine Student Assistance Process: Self-Evaluation Guide (1996) The Student Assistance 

Team Unit 

Manual is a guide on establishing and evaluating Student Assistance Teams; provides a simple set of tools. 

Source: The Student Assistance Team Unit, Maine School-Linked Services Project; 

96 Falmouth St.; P.O.Box 9300; Portland, Maine, 04104-9300; 

Phone: (207) 780-4430: FAX: (207) 780-4417; TDD: (207) 780-5646 

Center’s Clearinghouse Number: 1 405-26 



Title: Systems of Care for Children and Adolescents with Severe Emotional Disturbances: 

What Are the Results? (1993) B.A. Stroul (Ed) 

Details results of programs for children and adolescents with severe emotional disturbances. Lists values and 
principles and goals of system development. 

Source: CASSP Technical Assistance Center; Georgetown University Child Development 

Center, 3800 Reservoir Road, NW; Washington, D.C., 20007; Phone: (202) 687-8635 

Center’s Clearinghouse Number: 1 405-8 



Title: A Guide for Evaluating Consumer Satisfaction with Child and Adolescent Mental 

Health Services (1996) The Technical Assistance Center 



Handbook is a guide for evaluating consumer satisfaction with child and adolescent mental health services. 
Reviews the area of consumer satisfaction, presents a step by step approach for measuring satisfaction, and 
discusses how to select, modify, or create an instrument and how to interpret and use the results. 



Source: Judge Baker Technical Assistance Center, 295 Longwood Ave.; Boston, MA, 02115; 

Phone: (617) 232-8390, ext. 2139; FAX: (617) 232-4125; http;//tac.ple.org/eval 



Center’s Clearinghouse Number: 



1405-27 



Title: 



Family Health Outcomes Project Brochure (1996) 

A brochure describing the Project’s goals of facilitating rational policy development and needs-based program 
planning and service coordination at state and local levels. 

Source: The Family Health Outcomes Project; University of California, San Francisco 

School of Medicine; 1388 Sutter St., Suite 715; San Francisco, CA, 94109-5453 
Phone: (415) 476-5283; FAX: (415) 502-0848 

Center’s Clearinghouse Number: 1405-6 



Title: The Process Study Component of Mental Health Evaluation ( 1 994) 

R.D. Perry, B.H. Hoff, & D.S. Gaither 

Reviews progress made related to Washington State’s Mental Health Reform Act. 

Source: Evaluation and Program Planning, 77,43-46 

Center’s Clearinghouse Number: 1405-3 



Title: Integrating Systems of Care in California for Youth with Severe Emotional 

Disturbance. I. A Descriptive Overview of the California AB377 Evaluation Project 
( 1 992). A. Rosenblatt & C.C. Attkisson 

Reviews differences among ethnic groups. 

Source: Journal of Child and Family Studies, I, 93- 1 1 3 

Center’s Clearinghouse Number: 1405-14 



Title: The Case for Shifting to Results-Based Accountability with a Start-Up List of 

Outcome Measures with Annotations (1994) L.B. Schorr 

Report on the current ferment around using results in assessing the success of efforts to improve the lives of 
children and families and of shifting to a results-based accountability system. 

Source: The Improved Outcomes for Children Project, do Center for the Study of Social Policy 

1250 Eye St., NW, Washington, D.C., 20005 Phone: (202) 371-1565; FAX: (202) 371-1472 

Center’s Clearinghouse Number: 1405-13 



Title: Outcomes and Policy for Children and Families: Conference Reader (1993) prepared by 

T. McKennna 

A Reader from a conference sponsored by the Children’s Policy Council of California, USC School of Social 
Work, and Center for Collaboration for Children. Describes a county score card for measuring the well-being of 
children and includes several articles and an annotated bibliography. 

Source: USC School of Social Work, Mail Code 0411, Los Angeles, CA 90089-04 1 1 

Center’s Clearinghouse Number: 1405-12 



Title: Guidebook: Mental Health and School-Based Health Centers (1997) 

H. Adelman & L. Taylor 

This guidebook includes a module that explores quality improvement, evaluating outcomes, and getting credit 
for all you do. Also discusses the different stages of evaluation and offers resource aids (sample forms and 
special exhibits, questionnaires, interviews) for use as part of the day-by-day school-based health centers' 
operational focus on mental health and psychosocial concerns. 

Source: School Mental Health Project/Center for Mental Health in Schools, Dept, of Psycholos’y/UCLA; 

Los Angeles, CA, 90095-1563 Phone: 310-825-3634; FAX: 310-206-8716; 
http://smhp.psych.ucla.edu 
Center’s Clearinghouse Number: 1405-15 
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Title: Introductory Packet on Evaluation and Accountability (1997) 

UCLA School Mental Health Project/Center for Mental Health in Schools 

Provides basic references, internet resources, model programs, names from our Consultation Cadre, and other 
resources related to the topic. 

Source: School Mental Health Project/Center for Mental Health in Schools, Dept, of 

Psychology/UCLA; Los Angeles, CA, 90095-1563; 

Phone: (3 1 0) 825-3634; FAX: (3 1 0) 206-87 1 6; http://smhp.psych.ucla.edu 

Center’s Clearinghouse Number: 1405-9999 



Title: What Works in Children's Mental Health Services? (1996) K. Kutash & V.R. Rivera 

This is the third volume in a series focusing on evaluating the effectiveness of components of a system of care, 
gaining ideas for improving services, and taking advantage of research data. 

Source: Paul H. Brookes Publishing Co.; P.O. Box 10624; Baltimore, MD, 

Phone: (800) 638-3775; FAX: (410) 337-8539 

Center’s Clearinghouse Number: 1405-40 



Title: Sof^are Applications for Behavioral Health: A Directory and Resource Guide ( 1 996) 

National Community Mental Health Council 

Directory provides community behavioral healthcare providers with basic information on what software is 
available, what it will do, and how to get more information. Lists the hardware and software features of vendors 
working directly with the behavioral healthcare market. 

Source: National Community Mental Healthcare Council, 12300 Twinbrook Parkway, Suite 320, 

Rockville, Maryland 20852. Phone: (301)984-6200, Fax: (301) 881-7159. 

Center’s Clearinghouse Number: 1405-5 1 



Title: Outcomes of Mental Health Care for Children and Adolescents: H. Literature Review 

and Application of a Comprehensive Model (1996) P.S. Jensen, K. Hoagwood, & T. Petti 

Reviews the scientific literature to determine the extent of knowledge concerning the outcomes of mental health 
care for children and adolescents. Previous research is examined to determine the degree to which it addresses five 
salient outcome domains: symptoms/diagnoses, functioning, consumer perspectives, environments, and systems 
(the SFCES model). Concludes that service delivery systems must be modified to meet the specific clinical needs of 
children with mental disorders and to embrace new efficacious treatments as they become available. 

Source: Journal of the American Academy of Child Adolescent Psychiatry, 35, 1 064- 1 077. 

Center’s Clearinghouse Number: 1405-50 



Title: Measuring How We Care: Tools for Assessing Children's Mental Health Services, 

Programs and Systems (1996) The Technical Assistance Center 

Monograph critically reviews specific measures. Includes a table of system indicators and an appendix 
reviewing several service system evaluations. 

Source: Judge Baker Technical Assistance Center; 295 Longwood Ave.; Boston, MA; 02115; 

Phone: (6 1 7) 232-8390; FAX: (6 1 7) 232-4 1 25 

Center’s Clearinghouse Number: 1405-44 



Title: Sptem Accountability Project for Children's Mental Health ( 1 997) 

M. Hernandez & S. Hodges 

Focus is on promoting use of measurable outcomes by mental health providers. 

Source: System Accountability Project for Children’s Mental Health; Department of Child & Familv Studies; 

University of South Florida; 13301 N. Bruce B. Downs Blvd.; Tampa, Florida, 33612-3899 

Center’s Clearinghouse Number: 1405-48 




Title: Culturally Competent Evaluation of Outcomes in Systems of Care for Children's Mental 

Health (1996) -- series of articles 

Examines strategies that can make evaluations more responsive to issues of diversity in children's mental health. 

Source: TA Brief. 2(2 f Judge Baker Technical Assistance Center; 295 Longwood Ave.; Boston, MA; 02115; 

Phone: (617) 232-8390; FAX: (617) 232-4125 

Center’s Clearinghouse Number: 1405-43 



Title: National Plan for Research on Child and Adolescent Mental Disorders (1995) 

U.S. Department of Health and Human Services 

Report provides an overview of the major types of interventions now in use, including various forms of 
psychotherapy ("talk therapy" and behavior therapy) and pharmacotherapy ("medication" or "drug treatment"). 

Source: U.S. Department of Health and Human Services; Public Health Service; National Institute of Mental 

Health; 5600 Fishers Lane; Rockville, MD, 20857 

Center’s Clearinghouse Number: 1405-47 



Title: Making a Difference: Moving to Outcome-Based Accountability for Comprehensive 

Service Reforms (1994) N. Young, S. Gardner, S. Coley, L. Schorr, & C. Bruner 

Report on improving the well being of students and their families with outcome and accountability as the center of 
attention. Stresses the need for a comprehensive, cross-system, and collaborative strategies to achieve success 
where the system has failed. 

Source: Individual copies of this resource brief are available for a $4.00 prepaid postage and handling fee. 

NCSl Information Clearinghouse, 5111 Leesburg Pike, Suite 702; Falls Church, VA 22041. 

Center’s Clearinghouse Number: 1405-42 



Title: Critical Issue Planning Session II: Documenting Effectiveness of School Mental 

Health Programs (1996) M. Weist 

Reports a discussion among national experts on issues and methods for document effectiveness of school mental 
health services. 

Source: Center for School Mental Health Assistance, University of Maryland c/o: Mark Weist, 

Dept, of Psychiatry. University of Maryland; 645 West Redwood St., Baltimore, MD, 21201; 

Phone: (410)328-6364 

Center’s Clearinghouse Number: 1405-10 



Title: A Reform Strategy to Improve Outcomes for All Children and Families ( 1 994) 

Improved Outcomes for Children Project 

Reports on a reform strategy to improve outcomes for children and families; explores principles, outcomes-based 
accountability, child and youth outcomes, community capacity for services and supports, community capacity to 
assess children’s well-being, attributes of effective services, professional development, outcomes, governance. 

Source: Improved Outcomes for Children Project (ICOP), Center for the Study of Social Policy; 

1250 Eye St., NW. Suite 503; Washington, D.C., 20005 Phone: (202) 371-1565: FAX: (202) 371-1472 

Center’s Clearinghouse Number: 1405-25 
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Title: National Adolescent and Child Treatment Study (NACTS): Outcomes for Children 

with Serious Emotional and Behavioral Disturbance (1996) P.E. Greenbaum, 

R.F. Dedrick, R.M. Friedman, K. Kutash, E.C. Brown, S.P. Lardieri, & A.M. Pugh 

Provides results of a study of children with serious emotional disturbance. Covers demographic and family 
characteristics, level of psychological and adaptive functioning, services received, and outcomes on how the 
children fared over time. Results indicated that problems were severe at entry into the study and remained so for 
children at the study's end. 

Source: Journal of Emotional and Behavioral Disorders, 4 130-146 

Center’s Clearinghouse Number: 1405-41 



Title: Planning for Evaluation: A Guide for Healthy Start Grantees and Other 

Collaboratives Serving School Children and Families (1996) M. Honig 

Guide for collaboratives that are planning or implementing comprehensive services initiatives serving school children 
and their families. Designed to help (I) collaboratives design a local evaluation of their sites and use evaluation to 
improve their own effectiveness, (2) sites use information from their evaluation to build long-term, local commitment 
to their initiative, (3) collaboratives work through some of the issues they will need to address in order to respond to 
the formal requirements of the statewide evaluation of Healthy Start conducted by the CA Department of Education. 

Source: Healthy Start Field Office, CRESS Center, Division of Education, University of California at Davis, 

Davis, California 95616-8729, Phone: (530) 752-1277, Fax: (530) 752-3754. 

Center’s Clearinghouse Number: 1405-52 



Title: Multi-Stage Evaluation for a Community Mental Health System for Children 

(1993) K. Kutash, A. Duchnowski, M. Johnson, & D. Rugs 

Presents a model for developing an evaluation of community mental health systems of care for children. Has a 
(I) Program Stage, (2) Effectiveness Stage, and (3) Impact Stage. Several measures and instruments are suggested. 

Source: Administration and Policy in Mental Health, 20, 3 1 1-322. 

Center’s Clearinghouse Number: 1405-39 



Title: Self-Report Family Inventory (1993) R.B. Hampson & W.R. Beavers 

Measures family system competence and style from family members' perspective. Also available are a chapter on 
the Beavers Systems Model of Family Assessment and articles on use of the SFI to measure family functioning. 

Source: Robert Hampson; Dedman College; P.O. Box 750442; Dallas, TX, 75275-0442 

FAX: (214) 768-3910; email: rhampson@mail.smu.edu 

Center’s Clearinghouse Number: 1405-37 



Title: Evaluation Handbook (1 995) J. Wilde, & S. Sockey 

Includes an overview of the components of evaluation, describes planning, implementation, amd reporting 
processes. Appendices provide a variety of resource aids. 

Source: Evaluation Assistance Center- Western Region, New Mexico Highlands University, Rio Rancho, 

New Mexico 87124 



Center’s Clearinghouse Number: 1405-36 



Title: Quality Assurance in Mental Health Care (1988) J. Zusman 

Designed to familiarize mental health care professionals with the terminology and activities of quality assurance 
and how they relate to other health care monitoring programs. 

Source: Hospital and Community Psychiatry, 39, 1286-1290. 

Center’s Clearinghouse Number: 1405-35 



Title: Quality Assurance for Mental Health Activity (1996) H. S. Adelman 

Defines and discusses what is involved in and how to develop quality assurance processes; includes a reference list 
and a table describing the stages in developing and evaluating such processes 

Source: Center for Mental Health in Schools, UCLA. Ph: (310) 825-3634; Fax: (310) 206-8716; 

email: smhp@ucla.edu; website: http://smhp.psych.ucla.edu 

Center’s Clearinghouse Number: 1405-34 



Title: Quality Assurance in Outpatient Psychotherapy (1988) S.A. Shueman & W.G. Troy 

Applies quality-assurance mechanisms to the planning, delivery, and monitoring of outpatient mental health 
services. The emphasis is on promising strategiesfor independent practice. 

Source: In G. Strieker & A.R. Rodriquez (Eds.), Handbook of Quality Assurance in Mental Health. NY: 

Plenum Press: (800) 221-9369 

Center’s Clearinghouse Number: 1405-33 



Title: A Comprehensive and Practical Quality Assurance Program for Community 

Mental Health Services (1991) A.B. Eppel, C. Fuyarchuk, D. Phelps, & A.T. Phelan 

Describes how a comprehensive quality-assurance program, with a multidisciplinary, multiprogram mental health 
clinic, was implemented. Reviews structure, process, and outcomes. 

Source: Canadian Journal of Psychiatry, 36, 102-106 

Center’s Clearinghouse Number: 1405-32 



Title: The Evaluation Handbook: A Dropout Prevention Research Report (1992) 

J. Smink & P. Stank 

Outlines six phases: 1) identifying evaluation elements; 2) generating evaluation questions; 3) selecting a design, 
collecting, and analyzing data; 4) instrumentation; 5) collecting, summarizing, and interpreting data; and 6) the 
evaluation report. 

Source: The National Dropout Prevention Center; 205 Martin St.; Clemson University; Clemson, 

South Carolina, 29634-5111; Phone: (803) 656-2599 



Center’s Clearinghouse Number: 



1405-31 



Title: How Shall We Study Comprehensive Collaborative Services for Children and 

Families? (1995) M.S. Knapp 

Addresses the challenges to researchers and evaluators in studying comprehensive, collaborative services for 
children and families. The challenges include interaction of multiple professional perspectives and specifying 
independent and dependent variables. The best evaluations are seen as strongly conceptualized, descriptive, 
comparatively bottom-up, and skeptical. 

Source: Educational Researcher, 24, 5-16 

Center’s Clearinghouse Number: 1405-30 

Title: School/Community Collaboration: Comparing Three Initiatives (1995) C.R. Stone 

Evaluation of the strengths and weaknesses of three school-community programs in San Diego. 

Source: Phi Delta Kappan, 76, 794-800. 

Center’s Clearinghouse Number: 1 405-29 

Title: A Practical Guide: Fund-Raising for Local Evaluations of Children's Mental Health 

Programs (1996) Technical Assistance Center 

Handbook addresses ways to secure funding for local evaluation of children's mental health programs. 

Source: Judge Baker Technical Assistance Center; 295 Longwood Ave.; Boston, MA, 02115 

Phone: (617) 232-8390, ext. 2139; FAX: (617) 232-4125; http://tac.pie.org/eval 

Center’s Clearinghouse Number: 1405-28 



Title: TA Brief: Evaluating Children's Mental Health Care Systems in a Managed Care 

Environment: An Overview (1995) K. Dym 

Presents different viewpoints and approaches to evaluating children’s mental health under managed care. Outlines 
four evaluation case studies, describes Section 1115 waiver evaluations at the federal level, and addresses concerns 
about culture and cultural competence related to evaluation of children’s managed mental health care. 

Source: 7>l Brief, 1(2), Judge Baker Technical Assistance Center; 295 Longwood Ave.; Boston, MA, 02115; 

Phone: (617) 232-8390, ext. 2139; FAX: (617)232-4125; http://tac.pie.org/eval 

Center’s Clearinghouse Number: 1 405-54 



Title: TA Brief: Family Collaboration in Systems Evaluation (1995) J. Barnes 

Discusses the family role in evaluation. Includes an article that reviews ways in which families can collaborate 
with professionals in developing and utilizing an evaluation, an article that discusses a model of family 
involvement and another article that presents an overview on family outcome measurement. 

Source: TA Brief 1(1) , Judge Baker Technical Assistance Center; 295 Longwood Ave.; Boston, MA, 02115; 

Phone: (6 1 7) 232-8390, ext. 2 1 39; FAX: (6 1 7) 232-4 125; http://tac.pie.org/eval 



Center’s Clearinghouse Number: 



1405-55 
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Evaluation and Accountability 

Consultation Cadre 

Professionals across the country volunteer to network with others to share what they know. Some 
cadre members run programs; many work directly with youngsters in a variety of settings and focus 
on a wide range of psychosocial problems. Others are ready to share their expertise on policy, 
funding, and major system concerns. The group encompasses professionals working in schools, 
agencies, community organizations, family resource centers, clinics and health centers, teaching 
hospitals, universities, and so forth. 

People ask how we screen cadre members. We don't! It's not our role to endorse anyone. We think 
it's wonderful that so many professionals want to help their colleagues, and our role is to facilitate the 
networking. If you are willing to offer informal consultation at no charge to colleagues trying to 
improve systems, programs, and services for addressing barriers to learning, let us know. Our list is 
growing each day; the following are those currently on file related to this topic. Note: the list is 
alphabetized by Region and State as an aid in finding a nearby resource. 

Central States 

Missouri 

Sandra Nichols 
Missouri Dept, of Elementary 
Secondary Education 
P.O. Box 480 
Jefferson City, MO 65202 



Minnesota 

Gordon Wrobel 

Mental Health Consultant 

Minnesota Dept of Children, Families & Learning 

830 Capitol Square Building 

St. Paul, MN 55101 

Phone; 612/297-1641 

Fax: 612/297-7368 

Email: gordon.wrobel@state.mn.us 



East 



District of Columbia 
Ronda Talley 

425 Eighth Street, NW, #645 
Washington, DC 20004 
Phone: 202/393-0658 
Fax: 202/393-5864 
Email: rct.apa@email.apa.org 

Maryland 

Kristin Langlykke 

Maternal and Child Health Bureau 

Oflficc of Adol. Health 

5600 Fisher Lane 

Rockville, MD 20857 

Phone: 301/443-4026 

Email: ncemchO I @gumedlib. dml.georgetown.edu 
Maine 

Ellen Bowman 

LCPC-Clinical Counselor 

Maranacook Community School-Student 

P.O. Box 177 

Readfield, ME 04355 

Phone: 207/685-3041 







New York 

Christopher Cinton 
Project Director 

Bronx-Lebanon Hospital Center 
1650 Grand Concourse 
Bronx, NY 10457 
Phone: 718/960-1328 
Fax: 718/583-0460 

Pennsylvania 

Patricia Welle 

Student Services Coordinator 

School District of the City of Allentown 

3 1 South Penn Street 

P.O. Box 328 

Alllentown, PA 18105 

Phone: 610/821-2619 

Fax: 610/821-2618 

Rhode Island 

Robert F. Wooler 
Executive Director 

j[ 7^ Rl Youth Guidance Center, Inc. 

82 Pond Street 
Pawtucket, Rl 02860 
Phone: 401/725-0450 



Southeast 



Alabama 

Deborah Cleckley 

Director, Quality Assurance/Education 
Jefferson County Department of Health 
1400 6th Avenue, South 
Birmingham, AL 35233-2468 
Phone: 205/930-1401 
Fax: 205/930-1979 

Florida 

Howard Knoff 

Professor and Director 

School Psychology Program 

University of South Florida 

4202 East Fowler Avenue, FAO lOOU 

Tampa, FL 33620-7750 

Phone: 813/974-9498 

Fax: 813/974-5814 

Email: knoff@tempest.coedu.usf.edu 

Georgia 

Peter A. Cortese 

Chief Program Development and Services Branch 
Center for Disease Control and Prevention 
Division of Adolescent and School Health 
4770 Buford Highway, N.E., MS-K3 1 
Atlanta, G A 30341-3724 
Phone: 404/488-5365 
Fax: 404/488-5972 
Email: pac2@ccdashl.em.cdc.gov 

Louisiana 

Theresa Nash 

Administrative Supervisor of School Nurses 
New Orleans Public Schools 
Medical and Health Services Department 
820 Girod St. 

New Orleans, LA 70113 
Phone: 504/592-8377 
Fax: 504/592-8378 



North Carolina 
Bill Hussey 
Section Chief 
Dept, of Public Instruction 
301 N. Wilmington St. 

Raleigh, NC 27601-2825 
Phone: 919/715-1576 
Fax: 919/715-1569 
Email: bhussy@dpi.state.nc.us 

William Trant 

Director Exceptional Programs 
New Hanover County Schools 
1802 South 15th Street 
Wilmington, NC 28401 
Phone: 910/815-6935 
Fax: 910/815-6929 
Email: nhcsswrt@uncwil.edu 

Virginia 

Sally McConnell 

Director of Government Relations 

National Association of Elementary School Principals 

1615 Duke Street 

Alexandria, VA 22314 

Phone: 703/518-6263 

Fax: 703/548-6021 

Email: sallymac@ix.netcom.com 



Southwest 



California 

Frank Binch 

Department of Health Services County of Los Angeles 
1200 N. State St. 

Los Angeles, CA 90033 
Phone: 213/226-8326 
Fax: 213/226-8320 

Email: 73267.2635@compuserve.com 



Howard Blonsky 

Coordinator, Beacon Schools 

San Francisco Unified School District 

1512 Golden Gate Avenue 

San Francisco, CA 94115 

Phone: 4 1 5/749-3400 

Fax: 415/749-3420 
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Southwest (cont.) 



California (cont.) 

Jim Bouquin 
Executive Director 
New Connections 
1760 Clayton Rd. 

Concord, CA 94520 
Phone: 510/676-1601 

June Cichowicz 

Community Relations Director 

Crisis and Suicide Intervention of Contra Costa 

P.O. Box 4852 

Walnut Creek, CA 94596 

Phone: 510/939-1916 

Fax: 510/939-1933 

Lois Coleman-Lang 

Coordinator of Health Services / Tracy Public Schools 

315 East I Ith Street 

Tracy, CA 95376 

Phone: 209/831-5036 

Fax: 209/836-3689 

Georgiana Coray 

CA Assoc, for School-Based & 

School Linked-Health Centers 
7956 Grape St. 

La Mesa, CA 91941 
Phone: 619/464-3988 

Alfredo Crespo 
Psychologist 

San Fernando Valley Child Guidance Clinic 
9650 Zelzah Ave. 

Northridge, CA 91325 
Phone: 818/506-1348 
Fax: 818/998-2726 

Kimberly Dark 

Community Program Coordinator 

Reachout to Families 

South Bay Union School District 

610 Elm Avenue 

Imperial Beach, CA 91932 

Phone: 619/575-5917 

Fax: 619/424-9607 

Sylvia Dean 

Coordinator of Psychological Service 
Los Angeles School District 
1 1380 W. Graham Place - Bldg. Y 
Los Angeles, CA 90064 
Phone: 310/444-9913 
Fax: 310/914-9760 



California (cont.) 

John Hatakeyama 
Deputy Director 

Children and Youth Services Bureau 

L.A. County Dept, of Mental Health, C&FSB 

505 S. Virgil Avenue 

Los Angeles, CA 90020 

Phone: 213/738-2147 

Fax: 213/386-5282 

Susan Lordi 

Administrative Project Director 

Los Angeles County Office of Education 

9300 Imperial Highway, Room 210 

Downey, CA 90242-2890 

Phone: 310/922-6377 

Fax: 310/922-6299 

Email: Iordi_susan@mssmtp.Iacoe.edu 

Michael Pines 
Consultant 

Div. of Career & Family Servs. L A Cnty. Office of Ed. 

9300 Imperial Highway 

Downey, CA 90242-2890 

Phone: 310/940-1683 

Fax: 310/940-1877 

Email: pines_michael@lacoe.edu 

Marcel Soriano 
Associate Professor 

Division of Administration and Counseling 

California State University, Los Angeles 

5151 State University Drive 

Los Angeles, CA 90032-8141 

Phone: 213/343-4381 

Fax: 213/343-4252 

Email: msorian@calstateIa.edu 

Colorado 

James R. Craig 
Director 

Adams Child and Family Services 
7840 Pecos St. 

Denver, CO 80221 
Phone: 303/853-3431 
Fax: 303/428-0233 

Texas 

Jenni Jennings 
Clinical Supervisor 
Youth & Families Centers 
Dallas Public Schools 
P.O. Box 4967 
Dallas, TX 75208 
Phone: 214/827-4343 
Fax: 2 14/827-4496 



Prepared by ihc School Mental Health Project/ 
Center for Mental Health in Schools. UCIj\ 



1 




U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 
National Library of Education (NLEj 
Educational Resources Information Center (ERIC) 




NOTICE 



REPRODUCTTON BASTS 




This document is covered by a signed “Reproduction Release 
(Blanket) form (on file within the ERIC system), encompassing all 
or classes of documents from its source organization and, therefore, 
does not require a “Specific Document” Release form. 




This document is Federally-funded, or carries its own permission to 
reproduce, or is otherwise in the public domain and, therefore, may 
be reproduced by ERIC without a signed Reproduction Release form 
(either “Specific Document” or “Blanket”). 




EFF-089 (9/97) 




